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Background / Context: 

In the US, mathematics achievement is often regarded as essential for individual 
educational and economic success as well as national global competitiveness (Chazan, 2008; The 
College Board, 2000). Indeed, recent evidence suggests that increasing the number of years of 
mathematics required of students raises earnings, especially among disadvantaged minorities 
(Goodman, 2013). Beginning with Sputnik in 1957 and continuing with A Nation at Risk (1983) 
and more recent reports (see for example, NCES, 2013; National Mathematics Advisory Panel, 
2008), policymakers have called for increased proficiency in math as a national imperative 
(Gardner, 1983; Tate, 1997). Efforts thus have focused on increasing the amount and rigor of 
mathematics course taking, with a particular focus on exposure to algebra (Adelman, 2006). As a 
key pre-requisite for a sequence of courses culminating in college-level classes such as calculus 
and statistics. Algebra I is considered a critical “gatekeeper” course (Adelman, 2006; Education 
Commission of the States, 2008). Research has documented the relationship between algebra 
enrollment and a variety of educational and economic outcomes (Adelman, 2006; NCTM, 1989; 
Gamoran & Hannigan, 2000; Ham & Walker, 1999, Stein et al, 2011). Yet, much of this research 
suffers from selection bias (Stein et al, 2011) and therefore does not support causal claims about 
the impact of algebra. 

In studies of the impact of universal algebra policies, researchers unsurprisingly find that 
such policies increase algebra enrollment (Allensworth, et al, 2009; Burris et al, 2006; Everson 
& Dunham, 1996; Stein et al, 2011). Impacts on student achievement, however, are mixed (Stein 
et al, 2011). Clotfelter and colleagues (2011) find negative effects of accelerating low-skilled 
students into Algebra I in 9*’^ grade. Ninth grade universal algebra in Chicago negatively 
impacted the mathematics achievement of high-skilled students placed in heterogeneous classes 
(Nomi, 2012). While the Chicago policy increased overall algebra credit accumulation, it also 
increased failure rates across ability groups, and it did not lead to improved standardized test 
scores (Allensworth et al, 2009). For low performing students assigned to a “double dose” of 
algebra, the policy yielded positive short-term impacts on GPA and standardized test scores 
(Nomi & Allensworth, 2009) but also a positive increase in course failure rates. In the longer 
term, the double-dose strategy yielded positive effects on ACT performance, high school 
graduation, and college entrance (Cortes, Goodman & Nomi, 2012). Thus, there may be promise 
for algebra enrollment policies when combined with appropriate support for underprepared 
students, although care must be taken with how such policies are implemented (Nomi & 
Allensworth, 2013). 

In the face of ongoing debates and mixed evidence on universal placement strategies, 
practitioners and policymakers have begun to seek alternative, objective mechanisms to advance 
students’ mathematics trajectories and to identify policies that might best encourage early and 
equitable exposure for students who are prepared. It is therefore important to understand the 
benefits and consequences of alternative mathematics course assignment strategies. 


Purpose / Objective / Research Question / Focus of Study: 

Description of the focus of the research. 
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The Wake County Publie Sehool System (WCPSS) in North Carolina reeently addressed the 
issue of advaneement in and equitable aeeess to advaneed mathematies. Under a reeent poliey, 
WCPSS uses a SAS-generated predieted probabilities of students’ sueeess in obtaining a passing 
seore on the NC Algebra I End-of-Course (EOC) exam, to determine reeommended eourse 
plaeement in grades 6 through 8. For example, 8* grade students with a 0.70 or higher 
probability of passing the Algebra I EOC are reeommended for Algebra I. We examine the 
question: do students who are just eligible for advaneement in mathematies in middle sehool and 
who partieipate in advaneed mathematies lead to improved aeademie outeomes eompared to 
students who just miss being eligible for advaneement and who do not enroll in advaneed 
mathematies. By foeusing on the students on the margin of eligibility under this poliey we use a 
regression-diseontinuity design to estimate the eausal impaet of this mathematies aeeeleration 
poliey on subsequent test seores, grades, and eourse-taking behavior of middle-sehool students in 
Wake County who were exposed to this poliey. 


Setting: 

Description of the research location. 

We foeus on middle sehool students in WCPSS. WCPSS is the largest sehool distriet in North 
Carolina and the 15th largest in the nation with over 150,000 students. The distriet is both 
raeially and eeonomieally diverse. We utilize a longitudinal student information system provided 
by WCPSS. This system assigns students unique identifiers that allow the distriet to follow their 
progress from primary sehool through seeondary sehool. For our purposes, the longitudinal 
strueture of this data makes this researeh possible by traeking students from the end of fifth 
grade, when they are assigned EVAAS seores that determine whether they will be aeeelerated in 
math, through middle and high sehool, where many of the most important outeomes of interest 
are measured. We ean traek students as long as they stay within WCPSS, and will explore 
whether aeeeleration affeeted the rate of attrition from the distriet. We use data for students who 
were in grades six through eight during the aeademie years 2010-2011 through 2012-2013. 

Population / Participants / Subjects: 

Description of the participants in the study: who, how many, key features, or characteristics. 

Our study includes student who were in the 6* through 8*'^ grades in the academic years 2010- 
2011 through 2012-2013 and were subject to this policy. 

Intervention / Program / Practice: 

Description of the intervention, program, or practice, including details of administration and duration. 

In contrast to blunt algebra-for-all policies, WCPSS sought to increase advanced mathematics 
course-taking by ensuring that all students who are prepared to be successful in Algebra I are 
enrolled as early as possible in their academic trajectory. Beginning in 2010, WCPSS 
implemented a targeted enrollment strategy through which they utilize a numeric criterion 
developed by the SAS Institute’s Education Value-Added Assessment System (EVAAS) to 
determine student eligibility for placement in advanced math coursework in the middle grades, 
including Algebra I in grade 8. We investigate the impact of this policy on student end-of-year 
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assessments in mathematies in grades 6, 7, and 8 during the poliey’s first two years of 
implementation. 

Research Design: 

Description of the research design. 

Students are eligible for advaneed mathematies if they have a 0.70 or higher estimated 
probability of passing the Algebra I EOC examination, but not all eligible students aetually 
enroll in the reeommended advaneed eourse. These diserepaneies between “eligibility” and 
“take-up” mean that the probability of a student enrolling in the advaneed mathematies eourse 
appropriate for his grade level does not jump sharply from zero to one at the EVAAS probability 
threshold of 0.70. As a result, we model the relationship between our outeome and predieted 
probability as a “fuzzy” regression diseontinuity (Imbens & Lemeiux, 2008; Mumane & Willett, 
2011). To do so, we employ a two-stage instrumental-variable analytie approaeh to estimate the 
effeet of partieipating in advaneed mathematies on our outeome, Y. Under the “fuzzy” approaeh, 
we first use eaeh student’s position relative to the probability eutoff as an instrument for take up 
of the offer of advaneed mathematies {ADVANCE). At the first stage, we fit the following model: 

[p(i4DEi4iVCEigr)] = tto + ai(CEVAAS)igr + a 2 ELlGigr + a 3 ((CEVAAS) x ELIG).^^ + 

X^jOi -f (pg -f (jOj. -f Sjgj., 


for student i in eohort g in sehool r, where (p and co represent the fixed effeets of eohort and 
sehool, and 5 is a residual. The seeond-stage model is then: 

Yigr = tto + TTi(CEVAAS)igr + TT2ADVANCEigr + Ti3 (CEVAAS) X ADVANCEigr+ 


X^jG -f cpg -f (jOj. -f 5jgj._ 


where Yjgj. represents a generie outeome. Beeause the seeond-stage predietor ADVANCEigj. is 
potentially endogenous, we replaee it at the seeond stage with its fitted values from the first-stage 
equation. The parameter of interest is tt 2 , the population eausal effeet of partieipating in 
advaneed mathematies in middle sehool for students who are just eligible to partieipate 
eompared to those who just missed eligibility. We interpret positive (negative) and statistieally 
signifieant estimates of tt 2 as an indieation that enrollment in an advaneed mathematies eourse 
impaeted students’ outeomes positively (negatively); we interpret a zero estimate as an indieation 
that enrollment in an advaneed eourse had negligible impaet on students’ outeomes. 

We perform all regression-diseontinuity analyses within a loeal-linear regression framework in 
eonjunetion with an optimal ehoiee of bandwidth (Imbens and Lemieux, 2008). We ehoose an 
optimal bandwidth by employing an automated proeedure eonsistent with Imbens & 
Kalyanaraman (2012), whieh uses a triangular kernel. By taking this approaeh to ehoosing 
optimal bandwidth and by modeling the relationship between the outeome and foreing variable 
as loeally linear, we address issues of bandwidth and funetional form in ways that are eonsistent 
with the literature. 
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Data Collection and Analysis: 

Description of the methods for collecting and analyzing data. 

We rely entirely on longitudinal administrative data from the WCPSS sehool system from the 
aeademie years 2010-2011 through 2012-2013 inelusive. These data inelude student 
demographies, sehool and eourse enrollment, eourse grades, and state standardized test seores 
from grades five through high sehool. The design of the aeeeleration poliey is sueh that we 
employ a regression-diseontinuity design to isolate the eausal effeet of the poliey on students 
who were just eligible and enrolled in aeeelerated mathematies eompared to those who just 
missed being eligible and did not partieipate. This is the loeal average treatment effeet, or the 
effeet of the poliey on poliey eompliers. 

Findings / Results: 

Description of the main findings with specific details. 

Our analyses yield evidenee of a signifleant, negative impaet of assignment to advaneed 
mathematies on student end-of-grade mathematies seores in the first two years of implementation 
(see Table 2). In partieular, students of eolor and 6* graders seem to bear the majority of the 
adverse impaet (see Table 2). Though the sign and magnitude of the effeets are relatively stable, 
the statistieal signifieanee differs somewhat by ehoiee of bandwidth. Results from our first-stage 
analysis indieate strong adherenee to the poliey’s rule for assigning students to these advaneed 
eourses (see Figure A1 and Table Al), and we find no evidenee that the effeets are 
heterogeneous by gender or raee. These findings are eonsistent with earlier work from Clotfelter, 
Ladd, and Vigdor (2011) and Nomi (2012) who also find a negative impaet of similar polieies. 

Conclusions: 

Description of conclusions, recommendations, and limitations based on findings. 

Our current conclusions are that students on the margin of eligibility and who participate in 
advanced mathematics in middle school may experience negative effects as a result of being in a 
peer group of more advanced ability, on average. We hypothesize that the negative effects may 
transfer as a result of a suboptimal match of ability or through negative psychological impacts of 
perceiving oneself as less able than your peers. That these effects are experienced 
disproportionately by groups that are historically less well represented in advanced mathematics 
classrooms is consistent with prior work. Further analyses will investigate additional outcomes, 
and investigate potential mechanisms for the negative impact of the policy, such as teacher 
quality and classroom peer effects, at the margin of assignment. 
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Figure Al, Probability of enrollment in an advanced mathematics by EVAAS probability, 
all grades. 
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Table Al, First-stage Estimates 



(1) 

Grades 6-8 

(2) 

Grade 6 

(3) 

Grade 7 

(4) 

Grade 8 

IK bandwidth 

0.254*** 

0.416*** 

0.228** 

0.117 


(0.056) 

(0.101) 

(0.103) 

(0.121) 

F 

20.3 

17.1 

4.9 

0.9 

N 

925 

251 

333 

334 

Bandwidth = 5 

0.244“* 

0.260*** 

0.261*** 

0.191** 


(0.051) 

(0.070) 

(0.077) 

(0.090) 

F 

23.3 

13.7 

11.4 

4.5 

N 

1,734 

638 

556 

540 

Bandwidth = 10 

0.193*“ 

0.165** 

0.220*** 

0.199*** 


(0.044) 

(0.067) 

(0.064) 

(0.068) 

F 

19.3 

6.0 

IZO 

8.6 

N 

3,564 

1,346 

1,123 

1,095 

Bandwidth = 20 

0.191*** 

0.143** 

0.197*** 

0.248*** 


(0.036) 

(0.055) 

(0.057) 

(0.050) 

F 

28.6 

6.8 

12.1 

24.4 

N 

8,0% 

3,092 

2,610 

2,394 

Bandwidth = 20, controls 

0.182*** 

0.142*** 

0.184*** 

0.266*** 


(0.037) 

(0.050) 

(0.054) 

(0.048) 

F 

23.7 

7.9 

11.7 

30.7 

N 

8,0% 

3,092 

2,610 

2,394 


Nt><ex Heli-n>slj«la»ticily robust standard ern>rsclusl«?r«i by middle scivxd aiv in parentheses (*p<. 10 ** p<.05 
p<.01). Each i\nv shows first stage estimates of the impact of eligibilit)' for advaivx'd coursetvork on the probability 
of enrollment in an advanced course. The coefficients shown are generated by local lirtear Regression using an edge 
kernel with the listed bandwidtK No additioital controls are included except in the final row. which curuiitions on 
gertder, race, LItP and disability status, prior math and reading score*, gradie level and middle school fixed eHects 
Below each avfficient is the l-statistic asMKnated with the excluded in-strumenL 
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Table A2, Instrumental-variable estimates including beterogeneity of effect by race and 
gender. 



(1) 

Math score, 
grades 6-8 

(2) 

.Math score, 
grade 6 

(3) 

Math score, 
grade 7 

(4) 

Math score, 
grade 8 

All students 

-0.292* • 

-0.582* 

0.043 

-0.286* 


(0.130) 

(0.325) 

(0.207) 

(0.162) 

N 

7,844 

2,991 

2,521 

2,332 

Female 

-0.355** 

-0.989* * 

0.226 

-0.263 


(0.155) 

(0.491) 

(0.241) 

(0.227) 

N 

4,095 

1374 

1,334 

1,187 

Male 

-0.275 

-0.190 

-0.180 

-0.388 


(0.227) 

(0.479) 

(0.302) 

(0.305) 

N 

3,749 

1,417 

1,187 

1,145 

Black or Hispanic 

-0.402* 

-0.639 

-0.015 

-0.431** 


(0.205) 

(0.391) 

(0.230) 

(0.200) 

N 

4,135 

1367 

1,361 

1,207 

White or Asian 

-0.171 

-0.486 

0.194 

-0.202 


(0.167) 

(0.498) 

(0.401) 

(0.220) 

N 

3,709 

1,424 

1,160 

1,125 


Notws HetL*io!>koda!>ticit\’ tubust standanl enoni clustea'd by middio school aa> in pawnthesos (* p<.10 *’ p<.05 
**• p<.01). Each row shows instmmonlal variables estimates for the listed sub-group of the impact of advanced 
courst-work on end of grade math scores. The ccvfficients shown are generated by Uval lirtear iegn*ssu>n using an 
edge kemt‘l with a bandwidth of 20. All legn'ssions cirndition on gender, race, I.TI’and disability' status, prior math 
and reading score, grade lev el and middle school fixed effects. 
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